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ABSTRACT 

The United States Training and Employment Service 
General Aptitude Test Battery (GATB), first published in 1947, has 
been included in a continuing program of research to validate the 
tests against success in many different occupations. The GATB 
consists of 12 tests which measure nine aptitudes: General Learning 
Ability; Verbal Aptitude; Numerical Aptitude; Spatial Aptitude; Form 
Perception; Clerical Perception; Motor Coordination; Finger 
Dexterity; and Manual Dexterity. The aptitude scores are standard 
scores with 100 as the average for the general working population, 
and a standard deviation of 20. occupational norms are established in 
terms of minimum qualifying scores for each of the significant 
aptitude measures which# when combined, predict job performance. 
Cutting scores are set only for those aptitudes which aid in 
predicting the performance of the job duties of the experimental 
sample. The GATB norms described are appropriate only for jobs with 
content similar to that shown in the job description presented in 
this report. A description of the validation sample and a personnel 
evaluation form are also included. (AG) 
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FOREWORD 



The United States Bnployment Service General Aptitude Test Battery (GATB) 
was first published In 19^7* Since that time the GATB has been Included 
in a continuing program of research to validate the tests against success 
In many different occupations. Because of its extensive research base the 
GATB has come to be recognized as the best validated multiple aptitude 
test battery in existence for use in vocational guidance. 

The GATB consists of 12 tests which measure 9 aptitudes; General Learning 
Ability, Verbal Aptitude, Numerical Aptitude, Spatial Aptitude, Form 
Perception, Clerical Perception, Motor Coordination, Finger Dexterity, and 
Manual Dexterity. The aptitude scores are standard scores with 100 as the 
average for the general working population, with a standard deviation of 20. 

Occupational norms are established in terms of minimum qualifying scores 
for each of the significant aptitude measures which, in combination, 
predict job performance. For any given occupation, cutting scores are set 
only for those aptitudes which contribute to the prediction of performance 
of the job duties of the experimental sample. It Is Important to recognize 
that another Job might have the same Job title but the job content might 
mot be similar. The GATB norms described In this report are appropriate 
for use only for jobs with content similar to that shown in the job 
description included In this report. 



Charles E. Odell, Director 
U.S. Bnployment Service 
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QATB Study # 2527, 2698 



DEVELOPMENT OF USES APTITUDE TEST BATTERY 

FOR 

Programmer, Engineering and Scientific (profess. & kin. ) 020.188-030 

S-316 



This report describes research undertaken for the purpose of developing 
General Aptitude Test Battery (GATB) norms for the occupation of 
Programmer, Engineering and Scientific (profess. & kin. ) 020.188-030. 
The following norms were established: 



GATB Aptitudes 


Minimum Acceptable 
GATB Scores 


General Learning Ability 


125 


Verbal Aptitude 


no 


Numerical Aptitude 


no 


Spatial Aptitude 


105 



RESEARCH SUMMARY - VALIDATION SAMPLE 

Sample : 

72 (62 male and 10 female) workers employed as Engineering ««<* Scientific 
Programmers at various establishments In California. 

Criterion : 

Supervisory ratings. 



Design; 

Concurrent (test and criterion data were collected at approximately the 
same time). 

Minimum aptitude requirements were determined on the basis of a job 
analysis and statistical analyses of aptitude mean scores, standard 
deviations, aptitude criterion correlations and selective efficiencies. 

Concurrent Validity : 

Phi Coefficient = .47 P/2 <.0005 

Effectiveness of Norms : 

Only of the nontest-selected workers used for this study were good 
workers; if the workers had been test-selected with the above norms, 

83$ would have been good workers. 32$ of the nontest-selected workers 
used for this study were poor workers; if the workers had been test- 
selected with the above norms, only 17$ would have been poor workers. 
The effectiveness of the norms is shown graphically in Table 1: 
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TABLE 1 





Effectiveness of Norms 






Without Tests 


With Tests 


Good Workers 


68* 


83* 


Poor Workers 


32* 


17* 



VALIDATION SAMPLE DESCRIPTION 



Size: 

N = 72 



Occupational Status: 

Hnployed workers. 

Work Setting : 

Workers were employed at the Aerojet General Corporation, Azusa; Aeronutrlc* 
Corporation, Newport Beach; Aerospace Corporation, El Segundo; Aerospace 
Corporation, San Bernardino; Jet Propulsion Laboratories, Pasadena; Tide- 
water Oil Company, Los Angeles. 

nmploypr Selection Requirements ; 

Education: College degree in mathematics, physics, or engineering. 

Previous Experience: None required. 

Tests: Aerojet General Corporation administers the IBM Programmer Aptitude 

Test but the test results are not considered as being conclusive 
In hiring. 

Other: Standard employment form and interview with both a Personnel 

Department Interviewer and a supervisor in the Computing Department. 

Principal Activities : 

The Job duties for each worker are comparable to those shown in the Job 
description on the Fact Sheet. 

Minimum Experience : 

All workers in the sample had at least five months total Job experience* 




5 



- 3 - 



TABLE 2 

Means, Standard Deviations (SD), Ranges, and Pearson Product -Moment Correlations 
with the Criterion (r) for Age, Education, and Experience 





M 


SD 


Range 


r 


Age (years) 


29.6 


6.1 


22-58 


-.160 


Education (years) 


16.5 


1.1 


14-20 


.155 


Experience (months) 


37.5 


24.3 


5-120 


.097 



EXPERIMENTAL TEST BATTERY 



All 12 tests of the GATE), B-1002B, were administered during the period June 
1962 to January 1964. 



CRITERION 

The criterion data consisted of supervisory ratings of Job proficiency made 
at approximately the same time as test data were collected. The worker's 
fist -line supervisor made two ratings with a time interval of at least two 
weeks between ratings. 

Rating Scale ; 

An adaptation of USES Form SP-21 "Descriptive Rating Scale" (See Appendix) 
This scale consisted of ten items covering different aspects of Job per- 
formance • Each item has five alternatives corresponding to different 
degrees of Job proficiency. 

Reliability : 

The coefficient of reliability between the two ratings is .90 indicating 
a significant relationship. Therefore, the final criterion consisted 
of the combined scores of the two sets of ratings. 



Criterion Distribution: 




Possible Range: 


20-100 


Actual Range: 


38-98 


Mean: 


68.0 


Standard Deviation: 


13.3 


Criterion Dichotomy: 





The criterion distribution was dichotomized into high and low groups by 
placing 32$ of the sample in the low criterion group to correspond with 
the percentage of workers considered unsatisfactory or marginal. Workers 
in the high criterion group were designated as "good workers" and those 
in the low group as "poor workers." The criterion critical score is 63. 
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APTITUDES considered for inclusion in the norms 



Aptitudes were considered for tryout In the normB on the basis of a qualita- 
tive analysis Of the Job duties involved and a statistical analysis 
of test and criterion data. Aptitudes S and Q which do not have a high 
correlation with the criterion were considered for inclusion in the norms 
because the qualitative analysis indicated they were important to the Job 
duties and the sample had a relatively high mean score and a relatively low 
standard deviation on these aptitudes. With employed workers a relatively 
high mean score or relatively low standard deviation may Indicate that some 
sample pre-selection has taken place. Tables 3 , 4, and 5 show the results 
of the qualitative and statistical analyses. 



TABLE 3 

Qualitative Analysis 

(Based on the analysis of the Job duties, the aptitudes listed below appear 

to be important for Job success.) 



Aptitude Rationale 

6 - General Learning Ability Required to learn, understand, and apply 

programming principles and techniques. 

Ability to learn functions and applications 
of data -processing equipment. Ability to 
learn and work with advanced mathematical 
principles and methodology to solve complex 
scientific and engineering problems. Ability 
to reason and make decisions based upon 
analysis of data. Ability to identify, ana- 
lyze, and organize mathematical or technical 
elements of a problem into logical sequence 
for computer processing. Ability to trans- 
late elements or terms of a problem into 
synthetic machine l an guage for computer 
direction and to prepare instructions for 
console operation. Ability to check program 
for accuracy and completeness, including 
computer operation. 
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Aptitude 

V - Verbal Aptitude 



U - Numerical Aptitude 



S - Spatial Aptitude 
Q, - Clerical Perception 



Rationale 



Required to read and understand work statements , 
procedural routines, and related data. Ability 
to Intelligently participate in briefing and 
conferences with person or persons involved In 
assigned project and to discuss procedural 
problems or to obtain additional Information. 
Ability to prepare written reports or to present 
oral reports as directed. Ability to docu- 
ment results ot analysis, develop plans, and 
prepare Instructions for console operators. 
Ability to read technical literature In order 
to keep current In new developments. 

Ability to Identify mathematical formulas, 
tables, and reference materials# Ability to 
compute mathematical formulas and equations 
which Include linear algebra, vector analysis, 
differential equations, and calculus. Ability 
to prepare accurate input and output data 
lists and to compile a nomenclature list con- 
taining symbols, descriptions, and units of 
measures for each mathematical element In a 
problem. 

Ability to mentally visualize flow of data , 
through a computer system and to develop block 
diagrams and flow charts. Ability to conceive 
spatial relationships which may occur between 
elements of scientific or engineering problems. 

Required to perceive pertinent detail in pro- 
gram documentation, assembled data, and recom- 
mended routines. Required to prepare input, 
output, and nomenclature lists. Required to 
translate flow chart steps and prepare Instruc- 
tions for console operations. Required to 
detect errors In program Instructions and to 
avoid perceptual errors in making computations. 
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TABLE 4 

Means, Standard Deviations (SD). Ranges, and Pearson Product -Moment 
Correlations with the Criterion (r ) for the Aptitudes of the GATE 



Attitude 


Mean, 


SD 


Range 


r 


G - General Learning Ability 


135.3 


12.5 


104-166 


.269* 


V - Verbal Aptitude 


128.4 


14.3 


96-162 


.242* 


N - Numerical Aptitude 


130.2 


13.2 


98-157 


.263* 


S - Spatial Aptitude 


123.9 


14.3 


88-153 


.150 


P - Form Perception 


22 2.0 


19.6 


87-170 


.151 


Q - Clerical Perception 


129.1 


13.9 


90-160 


.185 


K - Motor Coordination 


117.8 


16.8 


60-155 


.214 


F - Finger Dexterity 


99.3 


18.4 


56-148 


.170 


M - Manual Dexterity 


113.0 


21.5 


61-168 


.255* 




♦Significant at 


the .05 level 





TABLE 5 

Sunmary of Qualitative and Quantitative Data 



Type of Evidence 


Aptitudes 




G 


V 


N S 


p 


q 


K 


F 


M 


Job Analysis Data 
Important 


X 


T 


X 


X 




X 








Irrelevant 




















Relatively High Mean 


X 


X 


X 






X 








Relatively Lew Standard Deviation 


X 


X 


X 


X 




X 








Significant Correlation with 
Criterion 


X 


X 


X 












X 


Aptitudes to be Considered for 
Trial Norms 


G 


V 


N 


s 




SL 






M 
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DERIVATION AMD VALIDITY OF NORMS 



Final norms were derived on the basis of a comparison of the degree to which 
trial norms consisting of various combinations of Aptitudes G, V, N, S, Q, 
and M at trial cutting scores were able to differentiate between the 68$ of 
the sanple considered good workers and the 3 2 $ of the sample considered poor 
workers. Trial cutting scores at five -point Intervals approximately one 
standard deviation below the mean are tried because this will eliminate 
about one -third of the sample with three-aptitude norms* wr two-aptitude 
trial norms, minimum cutting scores of slightly more than one standard 
deviation below the mean will eliminate about one-third of the sample; for 
four-aptitude trial norms, cutting scores slightly less than one standard 
deviation below the mean will eliminate about one-third of the sample. The 
Phi Coefficient was used as a basis for comparing trial norms. The optimum 
differentiation for the occupation of Programmer, Engineering and Scientific 
OBO. 188-030 was provided by norms of 6-125, V-110, if -110, and S-105. The 
validity of these norms Is shown in Table 0 and is Indicated by a Phi 
Coefficient of *47 (statistically significant at the .0005 level). 



TABLE 6 



Concurrent Validity of Test Norms, G-125* V-110, N-110, and S-105 





Nonqualifying 


Qualifying 






Test Scores 


Test Scores 


Total 


Good Workers 


6 


43 


49 


Poor Workers 


14 


9 


23 


Total 


20 


52 


72 



Rd. Coefficient ($) = .47 Chi Square (Xy) « 16.1 

Significance Level = P/2 {.0005 



DETERMINATION OF OCCUPATIONAL APTITUDE PATTERN 



The data for this study did not meet the requirements for Incorporating the 
occupation studied into any of the 36 CAP'S Included In Section II of the 
Manual for the General Aptitude Test Battery . The data for this sample will 
be considered for future groupings of occupations in the development of new 
occupational aptitude patterns. 
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S — 3 1 6 

Programmer, Engineering and Scientific (profess, and kin.) 020. 188-030 

Check Study Research Summary 

Sample : 

45 male workers and 14 female workers employed as Scientific Programmers by 
various firms and governmental agencies in Ohio. 



TABLE 7 

Means, Standard Deviations (SD), Ranges and Pearson Product— Moment Correlations 
with the Criterion (r) for Age, Education and Experience-Cross-Validation Sample 







Mean 


SD 


Range 


r 


Age (years 


) 


31.8 


6.6 


23-48 


-.020 


Educat ion 


(years ) 


1 6.6 


1.2 


14-20 


.242 


Experience 


(months) 


68.7 


49.0 


24-232 


.091 



Criterion: 

Supervisory ratings. 

Design : 

Concurrent (test and criterion data were collected at approximately the 
same time ) . 

Principal Activities : 

The duties for this sample are comparable to those shown in the job descrip- 
tion in the Appendix. 

Concurren t Va I id ? ty : 

Phi Coefficient (0) = .27 (P/2 < .025) 

Effectiveness of Norms : 

Only 71% of the non-test— se lected workers used for this study were good 
workers; if the workers had been test-selected with the S-316 norms, 81% 
would have been good workers. 29% of the non— test-se I ected workers used 
for this study were poor workers; if the workers had been test-selected 
with the S-316 norms, only 19% would have been poor workers. The ef- 
fectiveness of the norms is shown graphically in Table 8. 

TABLE 8 

Effectiveness of S-316 Norms on Check Study Sample 

Without Tests With Tests 
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More Proficient Workers 
Less Proficient Workers 
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71% 

29% 



81 % 

19 % 



Means, Standard Deviations (SD), Ranges, and Pearson 
lations with the Criterion (r) for the Aptitudes of 



Product-Moment Corre- 
the GATB; N = 59 



G - General Learning Ability 
V - Verbal Apt itude 
N - Numerical Aptitude 
S - Spat ial Apt i tude 
P - Form Perception 
Q - Cler ical Apt itude 
K - Motor Coordination 
F - Finger Dexterity 
M - Manual Dexterity 



Mean 


SD 


Range 


r 


136.6 


15.0 


93- 1 64 


.484** 


128.2 


16.2 


90-168 


.395** 


131.7 


15.6 


94-159 


.404** 


124.6 


15.9 


81-163 


.279* 


117.6 


17.8 


84-156 


.170 


129. 1 


20.4 


87-196 


.285* 


1 19.6 


19.2 


78-151 


.199 


102.8 


21 .9 


66-157 


.210 


100.8 


20.9 


69-155 


.070 


■if 


signi f icant 


at the .05 


level 


-sb;- 


s ign i f icant 


at the .01 


leve 1 



TABLE 9 

Concurrent Validity of S-316 Norms 
(G-125, V- 1 10, N- 1 10, S-105) 
Check Study Sample 



More Proficient Workers 
Less Proficient Workers 
Tota I 



Nonqua 1 i tying 


Qua 1 ify ing 


Tota 1 


Test Scores 


Test Scores 




9 


33 


42 


9 


8 


17 


18 


41 


59 




Chi Square (X£) 


- M 



Phi Coefficient (0) = .2.7 
Significance Level = ? J2 < .025 
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SP-21 

(Adaption) 



DESCRIPTIVE Rf TING SCALE 
(For Aptitude Test Development Studies) 

Score 



RATING SCALE FOR . 

D.O.T. Title and Code 

Directions: Please read Form SP-20, "Suggestions to Raters" and then fill 

in the items listed below. In making your ratings, only one 
box should be checked for each question. 

Na tn e of employee 

(Last) (First) (Initial) 

Sex: Mal e Female 

Company Job Title: m 

How often do you see this employee in a work situation? 

( ) See him at work all the time. 

( ) See him at work several times a day. 

( ) See him at work several times a week. 

( ) Seldom see him in work situation. 

How long have you supervised him? 

( ) Under one month. 

( ) One to two months. 

( ) Three to five months. 

( ) Six months or more. 
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A. How much >''ork can he accomplish? (Ability to make efficient use of his ti"e . 

( ) Capable of low worl: output. Can perform only at a less than satisfactor 
rate. 

( ) Capable of fair work output. Can perform at a satisfactory rate. 

( ) Capable of good work output. Can perform at a fast rate. 

( ) Capable of high work output. Can perform at a very fast rate. 

( ) Capable of extremely high work output. Can perform at highest rate. 

B. How good is the quality of his work? (Ability to organize problems for 
machine solution, prepare essential data, and develop detailed instructions 
in conformance with quality standards.) 

( ) The grade of work could stand improvement. Performance is usually 
acceptable, but only meets minimum standards. 

( ) Performance is acceptable, but usually not superior in quality. 

( ) Performance is usually superior in quality. 

( ) Performance is almost always of the highest quality. 

( ) Performance always meets maximum standards. 

C. How much does he know about his work? (Understanding of the principles, 
methods, eouip^ent, and materials that have to do directly or indirectly 
with his work.) 

( ) Has little knowledge. Does not know enough to do adequate work. 

( ) Has limited knowledge. Knows enough to "get by". 

( ) Has moderate knowledge. Knows enough to do fair work. 

( ) Has broad knowledge. Knows enough to do good work. 

( ) Has complete knowledge. Knows work thoroughly. 
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How co m plete is his understanding of mathematics? (Ability to make 
necessarv cor.rirtations required to perform his work.) 

( ) Fair understanding. Computes the less difficult mathematics involved. 

( ) Satisfactory understanding. Computes most of the mathematics involved. 

( ) Very good understanding. Computes all but the most difficult mathe- 
matics involved. 

( ) Excellent understanding. Computes all of the mathematics involved. 

( ) Outstanding understanding. Computes complex problems involving 
theoretical mathematics. 



E. How accurate is he in his work? (Ability to avoid making errors in the 
develorment and preparation of program instructions.) 

( ) Fakes many errors. Work needs constant checking. 

( ) Fakes frequent errors. Work needs more checking than is desirable. 

( ) Fakes errors occasionally. Work needs only normal checking. 

( ) Fakes few errors. Work seldom needs checking. 

( ) Rarely makes an error. Work almost never needs checking. 

F. How well and accurately does he communicate with others? (Ability to 
understand and give instructions; or to obtain and transmit facts and 
ideas graphically, orally, and in writing.) 

( ) Has some difficulty in maintaining clear communication with others, 

( ) Has a little trouble with communication. Sometimes confuses others. 

( ) Satisfactory. Usually gives and takes information fairly accurately. 
( ) Better than average. Seldom has any difficulty with communication. 

( ) Excels in understanding and making himself understood. 
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G. How resourceful is he when something different comes up or something out 

of the ordinary occurs? (Ability to apply what he already knows to a new 

situation. Ability to make independent judgements and decisions.) 

( ) Often has difficulty handlinp new situations. Needs help on all but 
simple problems. 

( ) Sometimes knows what to do, sometimes doesn't. Can deal with problems 
that are not too complex. 

( ) Usually able to handle new situations. Needs help on only complex 
problems, 

( ) Practically always figures out what to do himself. Rarely needs 
help. 

( ) Always figures out what to do. Never requires help. 




H. How many practical suggestions does he make for doing things in better 

ways? (Ability to improve work methods . ) 

( ) Sticks strictly with the routine. Contributes nothing in the way 
of practical suggestions. 

( ) Slow to see new ways to improve methods. Contributes few practical 
suggestions. 

( ) Neither quick or slow to see new ways to improve methods. Contributes 
so™e practical suggestions. 

( ) Quick to see new ways to improve methods. Contributes more than his 
share of practical suggestions. 

( ) Extremely alert to see now ways to improve methods. Contributes a 
large number of practical suggestions. 

I. How much aptitude or facility does he have for this kind of work? (Worker's 

adeptness or knack for performing his work easily and well. ) 

( ) Has great difficulty doing his work. Not suited to this kind of work. 

( ) Usually has some difficulty doing his work. Not too well suited to 
this kind of work. 

( ) Does his work without too much difficulty. Fairly well suited to this 
kind of work. 

( ) Usually does his job without difficulty. Well suited to this kind of 
work. 

( ) Does his work with great ease. Exceptionally well suited for this 
kind of work. 

1 £ 



Considering all the factors already rated, and only these factors, how 
acceptable is bis work? (Worker's "all-around" ability to do his work,) 

( ) Of limited value to the organization. Performance somewhat inferior. 

( ) A fairly proficient worker. Performance generally acceptable. 

( ) A very good worker. Performance is acceptable. 

( ) A valuable worker. Performance usually superior. 

( / An unusually competent worker. Performance outstanding. 
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S-316 

FACT SHEET 



Job Title ; iTograzmer, Engineering and Scientific (profess. & kin. ) 

020.188-030 

Job Summry : Develops procedures and prepares diagrammatic pi»w f and written 
Instructions for solution of engineering and related scientific problems by 
means of automatic data-processlng equipment. 

Work Ferfamed : Develops procedures and prepares diagnostic plans and written 
Instructions for solution of engineering and related scientific problems by 
neans of autasstlc data-processlng equipment. Receives documented work state- 
sent and related data, sketches, or blueprints from Engineer or Scientist 
requesting computer program. Studies work statement and related data to 
become familiar with nature and scope of assigned project. Identifies math- 
ematical formulas, equations, and assumptions presented In support of problem. 
Ascertains extent and type of lnforaatlon to be processed and considers final 
output format. Makes decision on which procedural routine to utilize for 
computer processing. Examines data and related documentation to define pro- 
blem In terms of desired results and availability of data. Analyzes problem, 
working with scientific and mathematical formulas, tables, and reference 
materials; and prepares, as necessary, charts, tables, and diagrams to assist 
In analysis. Makes analytical and logical analysis to identity and define 
each detail of mathematical computations or technical elements of problem and. 
to arrange computations and elements Into logically inevitable or predictable 
Interrelationship and sequence. Reviews procedural routine, and ascertains 
that routine selected will be capable of being carried out within computer 
limitations. Analyzes and plans program to minimize required storage space 
and computer running time. Develops diagnostic plans, and prepares Instruc- 
tions for console operator. Defines elements of problem to be entered as 
Input data, and prepares Input data list. Defines elements of Information 
which will appear In output, and prepares output data list setting forth 
output format. Develops block diagrams and detailed flow charts to depict 
m a imer In which each nathematlcal and technical computation will be sequenced 
and to establish continuity of progression by which computer operations will 
copy data, process data, and print solution. Translates each flow chart step 
Into machine or problem -oriented language, and writes detailed coded Instruc- 
tions for subsequent transfer of Instructions to punch cards, punch tape, or 
magnetic tape. Prepares set of operating Instructions for console operator. 
Prepares and submits program report to supervisor for review and approval. 
Reviews and tests program for accuracy, completeness, and consistency. Pre- 
pares set of sample data or sub-routine for computer run to verify accuracy 
and completeness of program, i Ay, on occasion, operate computer to check 
program. Keeps abreast of new developments, and refers to technical literature 
In the field of computer programming. Attends dmqtany sponsored conferences. 
Institutes, or meetings and participates in discussions of program approaches 
for new and Improved types of computers. 
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Effectlveness of Worms : Only 68# of the nontest-selected workers used for 
this study were good workers; If the workers had been test-selected with the 
S -316 noma, 83 # would hare been good workers. 32# of the nontest-selected 
workers used for this study were poor workers; If the workers had been test- 
selected with the S-316 norms, only 17# would have been poor workers. 
(Validation saaple. ) 

Only 71# of the nontest-selected workers used for this study were good workers; 
If the workers had been test-selected with the S -316 norms, 8 l# would hare been 
good workers. 29 # of the nontest-selected workers used for this study were 
poor workers ; If the workers had been test-selected with the S-316 norms, only 
19# would have been poor workers. (Cross-Validation sample. ) 

Applicability of 8-316 Worms : The aptitude test battery Is applicable to 
Jobs which Include a majority oar duties described above. se5004 



